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Abstract. Face recognition systems must be robust to the variation of 
various factors such as facial expression, illumination, head pose and ag- 
ing. Especially, the robustness against illumination variation is one of 
the most important problems to be solved for the practical use of face 
recognition systems. Gabor wavelet is widely used in face detection and 
recognition because it gives the possibility to simulate the function of 
human visual system. In this paper, we propose a method for extract- 
ing Gabor wavelet features which is stable under the variation of local 
illumination and show experiment results demonstrating its effectiveness. 

1 Introduction 

Image-based face recognition systems can be categorized into two categories, that 
is, holistic based recognition system and feature-based recognition system [1-2]. 
In this section, we consider previous works which were proposed to suppress the 
influence of illumination variation in feature-based face recognition. 

Face recognition based on the local information such as Gabor wavelet fea- 
tures in feature points has advantage that recognition is not sensitive to the 
variation of head pose or illumination, compared to the holistic based recog- 
nition such as Eigenfaces, Fisherfaces, IC A (Independent Component Analysis) 
and HMM(Hidden Markov Model) [4-7] . Different models and methods were pro- 
posed to support local feature-based face recognition, such as AAM(Active Ap- 
pearance Model), LBP(Local Binary Pattern) and EBGM(Elastic Bunch Graph 
Matching) [8-18]. AAM is a geometrical and statistical model of face image, 
which is obtained by applying PGA or LDA to feature vectors consisting of co- 
ordinate and gray level intensity of feature points. LBP is a method to represent 
face image using binary vectors corresponding to each pixel, which are con- 
structed by comparing pixel value of each pixel enclosing a pixel with the value 
of center pixel. Many training data and time are needed to construct AAM or 
LBP-based classifier. 

EBGM is a matching method using Gabor wavelet features extracted from 
the face graph reflecting topological structure of human faces, where face graph 
is constructed by connecting landmarks (node) of face with edges [14]. Each 
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node of face graph has 40-dimensional Gabor wavelet coefficient vector corre- 
sponding to 5 frequencies and 8 directions. EBGM-based face recognition has 
drawback that estimation of landmarks and extraction of Gabor wavelet coeffi- 
cients are influenced by the illumination variation. To overcome such a weakness 
of EBGM, some researchers tried to develop techniques which can decrease the 
effect of illumination variation by applying normalization or DCT(Discrete Co- 
sine Transform) to the input image [16-18]. However, it is still difficult to remove 
the effect of local illumination variation simultaneously with global illumination, 
though their methods make it possible to suppress the effect of global illumina- 
tion variation to a certain degree. 

In this paper, we introduce a method extracting Gabor wavelet features and 
discriminant feature points from face image, which is robust against local illu- 
mination variation and shows high recognition efficiency. FERET and YaleB are 
used to demonstrate the effectiveness of our methods. 

2 Extraction of Robust Gabor Wavelet Features 

In this section, we describe a method extracting Gabor wavelet features from 
face images, which is robust against local illumination variation. Let I(l^) be an 
face image, where le" — {x,y) £ X x Y . Gabor wavelet transformation of /("af ) 
is defined as follows [14, 16]. 

Gj{lt)= [ -^')cP^' (1) 

J XxY 

Here, 

^jC^) = ^exp( 5^)[exp(ifcj^) -exp(-^)]. 
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j = n + 8v{0 < j < 39 = m). 

The second term in the integral of makes the kernel DC-free, that is, 

/ Wj{'^)(Plt = 0. The vector consisting of coefficients of Gabor wavelet trans- 
formation corresponding to each orientation and frequency for each point of face 
image is called jet and denoted by g{'^) = (Gi("^)), ...,Gm{'^)) = ))yLg. 
Gj{~^) can be calculated as shown in Eq.2 by considering the fact that Gj{lt) 
only depends on the points belonging to the neighborhood Dj{lt) of it from 
the property of kernel function and the characteristics of the calculation of 
Gabor wavelet coefficients. 
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(2) 



Djilt) is a small area compared to the input face image and therefore we 
can assume that gray level intensity of face image changes linearly according to 
the brightness and contrast of illumination in this area, i.e., 

I{-t') = a,j{lt) + a,,{-t)-I^^^-^p'),{lt' e D,{-^)) (3) 

Here, abj{'t) and acj{'^) are the average and standard deviation of gray 
level intensity in local area Dj{'^), and express brightness and contrast of illu- 
mination. From Eq.2 and Eq.3, we can calculate Gj{'^) as follows. 



Here, G,o(^) = and^,- = /^.^^^ 

—it , because the size of Dj{lt) changes depending on only j, not it. 

Thus, the following equation holds. 

G^{-t) = abj{-t)^j + aej{^)Gjo{-t) (4) 

Wc can think that Gjo{lt) is not influenced by the illumination variation 
because local illumination variation will appears only as the change of values 
of abjC^) and acj{'^)- By using GjQ{lt) as the Gabor wavelet coefficients in- 
stead of Gj{lt), wc can achieve the effect of normalization of local illumination 
variation. Gjo{lt) can be calculated as follows. 

Gjo{-t) = {Gj{^) - at,j{^)^j)M^) (5) 



3 Feature Point Selection using Separability of Classes 

In [19], authors proposed a method for selecting feature points using discriminant 
vector, but it is hard to say that it gives most discriminant points for Gabor 
wavelet features. Linear discriminant analysis is a method to find out subspace 
in which the separability of classes becomes maximum, where the separability of 
classes is defined as the ratio of between-class variation to within-class variation 
[20-23]. It can be considered that the points having big separability of classes 
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are the most discriminant points when selecting feature point. We calculate 
separability of classes using Gabor wavelet coefficient vector g{lt) for each point 
and select the points whose separability of classes are big as feature points for 
the extraction of jet. Here, Gabor wavelet coefficients only use magnitude and 
neglect phase component, i.e., g{'^) = (|Gjo('^)|)^o- 

Let Sw{~3^) and Sb{~^) be the within-class/bctween-class scatter matrix by 
considering feature vector g{l^) of fixed point as a random vector. Then, the 
value J('^) of the separability of classes for each G X x Y is calculated as 
follows [20]. 

tr{Sw{x)) 

We select Pp = {"^i, ■^jvl^('^i) > eo)^ = l)---)-^} as the candidate set 
for feature points, where eg is a threshold. Absolute value |G'jo('a^)| of Gabor 
wavelet coefficient does not change largely in the neighborhood of and thus 
correlation between feature vectors becomes large and value of becomes 
similar. This implies that the points of Pp are mainly placed in the neighbor- 
hoods of extreme points of the function : X x Y ^ R. To increase recog- 
nition rate, however, it is important not only to select feature points having big 
separability of classes but also to make the correlation between feature vectors 
small as possible. Thus, we finally select the points from Pp, which have a less 
correlation each other, using correlation between feature vectors and k-means 
clustering algorithm. Selection algorithm is describe below. 

Let g(l < q < N), I and c denote the number of groups, the number of step 
and the maximum repeat count. Let P^\k = 1, q) be the fc-th group in step 
I. Here, P^^ C Pp. And let x^^he the center of fc-th group in stpe I. 

Stepl: Initialize parameters I and x'f^ as I — and x'f^ = = 1, ■■■,q). 

Step2: Reassign points = 1, ■■■,N) to group P^''. Here, fcj is decided as 
follows. 



ki = argmaXjSij, Sij = ') = E{ } (7) 

Step3: li I < c and there is a point < i < N) which is reassigned, then 

increase I one and recalculate x'l^ and go to step 2. The center x^'^ of group P^'^ 
is calculated using the equation described below, where P^'^ = {"^i,!, '^i,qk}- 

(8) 



(J) _ ^jLlj{~^k,j) ■ ~^k,j 



Step4- If the above condition is not satisfied, then Pp = {x\, ...,Xq^} is the 
set of feature points. Finish algorithm. 
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Table 1. Recognition performance according to the number of feature points (%) 



4 Performance Estimation 

FA, FB, FC, Dl, D2 (3539 images) of FERET and YaleB (4500 face images, 10 
persons) are used for experiment. The purpose of the experiment is to confirm 
that recognition performance is increased in FC under illumination variation 
and YaleB, but dont decrease in FB, Dl and D2, compared to the previous 
methods, when we apply the method of the paper. For the experiment, 128 x 128 
image extracted from the image where the position of eyes arc given. The sum 
of similarities between jets is used as the similarity for performance estimation 
[14]. 

Table 1 shows the recognition performance according to the number of fea- 
ture points, when the method of paper is applied. As we can see in the table, 
recognition performance does not increase when the number of feature points is 
greater than 50. 
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Table 2. Comparison of recognition performance with EBGM (%) 



Table 2 shows the result of comparison between the mcithod of paper and 
EGBM in case that the number of feature points is 50. As we can know from 
the table, it is possible to remove performance degradation which is caused by 
the incorrect extraction of feature points under serious illumination variation 
(YaleB), if we apply the method of paper. However, if we fix landmark, the 
performance is decreased in case that there is no serious illumination variation. 
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Table 3 shows recognition performances in case that we use Gj{lt) and 
Gjoi'lS') as wavelet feature coefficients respectively. As we can see in the table, 
normalization of the paper demonstrates high recognition performance without 
being affected by the illumination variation even in case that there is a change 
of facial expression or aging . 
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Table 3. Recognition performance under normalization(%) 
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